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Attorney's Docket No.: 2037.2002-000 

PORT PACKET QUEUING 

BACKGROUND OF THE INVENTION 

A networking switch receives data packets from a number of ingress ports 

connected to the switch and provides the data packets to a number of egress ports 
5 connected to the switch. The switch determines the egress port to which the data 

packets are provided dependent on the destination address included in the data packet. 

A data packet received from an ingress port is stored in memory in the switch before 

being provided to the egress port. 

The memory in the switch may be a common memory, in which all received 
10 data packets from all the ingress ports are stored, before being provided to the egress 

ports. A non-blocking switch allows all data received for all ingress ports to be 

provided to the egress ports. Non-blocking switches typically include a common 

memory in order to make the maximum amount of memory available to each port. 

Typically, the switch includes a forwarding table implemented in forwarding 
1 5 logic in an ingress engine in the switch. The forwarding table is searched for a 

forwarding entry. The forwarding entry includes one or more egress ports to which the 

data packet is to be forwarded dependent on the destination address included in the 

received data packet. 

As a received data packet is stored in the common memory, the location of the 
20 data packet in the common memory is stored in one or more egress port queues 

dependent on the selected forwarding entry. The egress port queues are stored in 

memory in the switch. 
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If the received data packet is an IP Multicast data packet, the location of the data 
packet in the common memory is written in the egress port queue associated with each 
port in the IP Multicast group. If the received data packet is a broadcast data packet, the 
location in the common memory is written in all egress port queues. Thus, dependent 
5 on the type of data packet received, the location of the data packet in the common 
memory; that is, a packet pointer may be enqueued on more than one egress port queue 
in the port cycle in which it is received. However, when transmitting the data packet 
from multiple queues, only one packet can be transmitted per port cycle. Thus, the 
location of the data packet in the common memory is dequeued from only one egress 
1 0 port queue per port cycle. 

Thus the number of ports supported by the switch is limited by the speed at 
which the location of the data packet in the common memory can be enqueued on an 
egress port queue. A queue is typically implemented through a linked list in memory. 
Each entry in the linked list has two elements, a pointer element for storing the location 
1 5 of the data packet and a next pointer element for storing the location of the next entry on 
the linked list. Thus, two write accesses to memory are required to add the location of 
the data packet to the linked list, the first access writes the location of the data packet in 
common memory in the pointer element and the second access writes the location of the 
next entry in the next pointer element. 
20 In a non-blocking switch, in which no received data packets are blocked by the 

switch, the memory speed is selected such that the location of a received data packet 
stored in common memory can be written to all the egress port queues in a port cycle. 
Also, a large queue is required in order to store pointers to IP Multicast and broadcast 
data packets stored in a common memory. 
25 If the egress port queues are implemented in a linked list in Dynamic Random 

Access Memory ("DRAM") a large queue is provided but the number of pointers that 
can be enqueued for a received data packet is hmited by the speed of the DRAM. The 
number of pointers that can be enqueued for a received data packet is increased by 
implementing egress port queues in a Static Random Access Memory ("SRAM") 
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because SRAM is faster than DRAM. However, an SRAM cell is larger than a DRAM 
cell and therefore requires more area to provide a similar sized queue. 

SUMMARY OF THE INVENTION 
5 We present a queue with a fast enqueue. The queue includes a first memory 

having first memory access time and a second memory having a second memory access 
time. Control logic enqueues a pointer in the queue by writing the pointer to the first 
memory and transferring the pointer to the second memory. The first memory access 
time is less than the second memory access time. The first memory allows a pointer to 
1 0 be stored in multiple queues over multiple write cycles within a port cycle. Yet, the first 
memory can be relatively small since multiple pointers can be transferred together to the 
second memory from which only one pointer need be read per port cycle when 
dequeued. 

The control logic enqueues the pointer in the first memory in a single write 
1 5 operation since a linked listed is not established until the pointers are transferred to the 
second memory. 

The control logic may partially or fully fill a cache row in the first memory 
before transferring the cache row into the second memory in a single write operation. 
The entries in the cache row in the first memory are ordered by position in the cache 
20 row. The first memory preferably includes two cache rows. 

A packet vector stored in the second memory may include a cache row entry and 
a count of the number of pointers stored in a cache row entry. The packet vector stored 
in the second memory may include a link to a next packet vector in the queue. 

25 BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing and other objects, features and advantages of the invention will be 
apparent from the following more particular description of preferred embodiments of 
the invention, as illustrated in the accompanying drawings in which like reference 
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characters refer to the same parts throughout the different views. The drawings are not 
necessarily to scale, emphasis instead being placed upon illustrating the principles of the 
invention. 

Fig. 1 is a block diagram of a switch including a plurality of port queues 
5 according to the principles of the present invention; 

Fig. 2 is a timing diagram illustrating the enqueuing and dequeuing of packet 
pointers in the port queues shown in Fig. 1 ; 

Fig. 3 is a block diagram of one of the port queues 124a-e shown in Fig. 1 . 
Fig. 4 is a block diagram including the port queue logic shown in FIG 3 and 
1 0 associated logic for enqueuing, dequeuing, and transferring packet pointers in the port 
W queue shown in Fig. 3; 

J Fig. 5 is a block diagram illustrating a linked list of packet vectors in the packet 

vector DRAM shown in Fig. 3; 
.f; Fig. 6 is a block diagram of the SRAM cache, including 2 cache rows with each 

7 1 5 row including 12 packet pointer entries; 

- Fig. 7 is a block diagram of the port registers associated with the port queue 

H .,; shown in Fig. 4; 

I Fig. 8. Is a block diagram of a switch 100 including a forward vector for 

£ determining the queue on which to enqueue a packet pointer; 

20 Fig. 9A is a flow chart illustrating the steps performed in the enqueue engine 

shown in Fig. 4 for enqueuing a packet pointer in a port queue; 

Fig. 9B is a flow chart illustrating the steps performed to update port registers in 
the enqueue engine shown in Fig. 6; 

Fig. 10 is a flow chart illustrating the steps performed in the dump engine shown 
25 in Fig. 6 for transferring a cache row from SRAM cache to packet vector DRAM; 

Fig. 1 1 is a flow chart illustrating the steps performed in the dequeue engine 
shown in Fig. 6 for dequeuing a packet pointer from a port queue. 
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DETAILED DESCRIPTION OF THE INVENTION 

A description of preferred embodiments of the invention follows. 
Fig. 1 illustrates a switch 100 including a plurality of egress port queues 124a-e 
according to the principles of the present invention. A source node 102 and destination 
5 nodes 1 12a-e are shown connected to the switch 100. A data packet 126 received by the 
switch 100 at an ingress port 132 from source node 102 is forwarded through egress 
portsl30a-e to one or more destination nodes 1 12a-d dependent on a destination address 
encoded in a header included in the data packet 126. 

If the received data packet 126 is a broadcast data packet, the data packet 126 is 
1 0 forwarded to all destinations 1 1 2a-e. If the received data packet 1 26 is an IP Multicast 
;(3 data packet, the data packet 126 is forwarded to all members of the IP Multicast group 

; f ■: which may include one or more of destinations 1 1 2a-e. 

J: Upon receiving the data packet 126, the switchlOO first stores the data packet 

I 126 in segment buffer memory 108. The switch 100 then determines from the data 

7 1 5 packet's header to which egress ports 1 30a-e the data packet is to be forwarded. Having 

^ ; determined the egress ports 1 30a-e, the switch 1 00 writes a pointer to the location of the 

- data packet in segment buffer memory 108; that is a packet pointer 128 in the respective 

- egress port queues 124a-e. The egress port queues 124a-e are implemented in a 
memory separate from the segment buffer memory 108, The packet pointer 128 is 

20 written to an egress port queue 124a-e if the data packet 126 is to be forwarded to the 
respective egress port 130a-e. As shown in Fig. 1, data packet 126 is a broadcast data 
packet and a packet pointer 128 for data packet 126 has been enqueued on each egress 
port queue 124a-e. 

Thus, the packet pointer 128 may be enqueued in more than one egress port 
25 queue 124a-e per port cycle for a received data packet. However, the packet pointer is 
dequeued from only one of the egress port queues 124a-e per port cycle in order to 
transmit the data packet from the respective egress port 130a-e. Thus, the packet 
pointer 128 is enqueued on an egress port queue 124a-e faster than it is dequeued from 
the egress port queue 124a-e. 
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Fig. 2 is a timing diagram illustrating the enqueuing and dequeuing of packet 
pointers in the egress port queues 124a-e shown in Fig. 1 . Each port in the switch 100 
is allocated a fixed port cycle 200a-f in which to enqueue a packet pointer 128 by 
enqueuing the packet pointer 128 at the tail of an egress port queue 124a-e or to 
5 dequeue a packet pointer 128 from an egress port queue 1 24a by reading the packet 
pointer 128 stored at the head of the egress port queue 124a-e 

Six port cycles 200a-f are shown in Fig. 2, one for each ingress port 132 and 
egress port 130a-e in the switch 100. Each port cycle 200a-f is further divided into 
enqueue cycles 202a-e. The number of enqueue cycles 202a-e is dependent on the 
t; 1 0 number of egress port queues 124a-e in the switch 1 00. Thus, five enqueue cycles 

\?i 202a-e, are provided one for each of the egress port queues 124a-e shown in Fig. 1 . 

J | A packet pointer may be enqueued on each egress port queue 124a-e in the 

' ;* switch 1 00 in enqueue cycles 202a-e in a port cycle 200a-e. However, only one packet 

5 pointer is dequeued from an egress port queue 124a-e in a port cycle 200a-e. Thus, a 

% 1 5 packet pointer enqueue cycle time must be faster than a packet pointer dequeue cycle 

£ time. In the example shown, the dequeue cycle time is five times slower than the 

• I j enqueue cycle time. Therefore, a packet pointer is enqueued in fast memory; that is 

5 memory with a fast access time. However, because only one packet pointer is dequeued 

from the corresponding port queue 124a-e in each port cycle 200a-e, the packet pointers 
20 are dequeued from slow memory; that is, memory with a slower access time than the 
fast memory required for enqueuing the packet pointer. 

Fast memory is preferably SRAM with a fast access time. However fast 
memory is not limited to SRAM. It may be any other memory with a sufficiently fast 
access time. For example, fast memory may be DRAM with a sufficiently fast access 
25 time. 

Slow memory is preferably DRAM because a DRAM requires less gates than an 
SRAM. However, the slow memory is not limited to DRAM. It may be any other slow 
memory similar to DRAM. In an embodiment in which DRAM is used for both fast 
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memory and slow memory, the slow memory time may be equal to the fast memory 
access time. 

Fig. 3 is a block diagram of one of the port queues 124a-e shown in Fig. 1. The 
port queues 124a-e include slow memory and fast memory. The packet vector DRAM 
5 300 is slow memory. The SRAM cache 302 is fast memory with a faster access time 
than the access time of the packet vector DRAM 300. In one embodiment the packet 
vector DRAM 300 is implemented in DRAM with a slow access time and the SRAM 
cache 302 is implemented in SRAM with a faster access time than the packet vector 
DRAM 300. 

1 0 Packet pointers 128 are enqueued in the SRAM cache 302 and dequeued from 

the packet vector DRAM 300 in the same order in which the packets are received at the 
ingress port 132. The SRAM cache 302 includes two cache rows 304a-b. Each cache 
row 304and 304b includes a plurality of packet pointer entries 306. A packet pointer 
128 may be stored in a packet pointer entry 306. 

1 5 After a received data packet 1 26 (Fig. 1) is stored in segment buffer memory 1 08 

(Fig. 1), the packet pointer is forwarded to the egress port queue 124a-e on packet 
pointer data_in 308. The packet pointer 128 is written to the next sequential packet 
pointer entry 306 in the cache row 304a or 304b which is currently being filled. 

Only one write cycle is necessary to enqueue the packet pointer 128 in a packet 

20 pointer entry 306 at the tail of the egress port queue 124a-e. No link pointer is 

necessary because the packet pointer 128 is written to the next sequential packet pointer 
entry 306. Thus, the packet pointers are ordered by position in the cache row 304a or 
304b. 

In an alternative embodiment, the SRAM cache 302 may be implemented in 
25 DRAM with an access time at least as fast as SRAM in order to reduce the size of the 
port queues 124a-e. The access time of packet vector DRAM 300 may be equal to the 
access time of the SRAM cache 302. The advantage implementing the port queue 
124a-e with two separate DRAMs with the same access time is that a packet pointer can 
be added to the link list in a single memory access and an enqueue operation and 
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dequeue operation can be performed in parallel by having a separate enqueue and 
dequeue memory. 

The minimum enqueue cycle 202a-e (Fig. 2) is dependent on the minimum 
memory access cycle for the SRAM cache 302. For example, if a port cycle is 120ns 

5 and SRAM cache 302 includes 5 egress port queues 124a-e, each enqueue cycle 202a-e 
is 120/5 = 25ns and each dequeue cycle is 120ns. In a dequeue cycle the packet pointer 
128 is read and the pointer to the next packet pointer 128 is updated. Thus a read 
memory access cycle and a write memory access cycle is performed in each dequeue 
cycle requiring a packet vector DRAM 300 with a 60ns memory access time. One write 

1 0 memory cycle access memory is performed in each enqueue cycle requiring an SRAM 
cache 302 with a 25ns access time. 

After a packet pointer 128 has been written to the last packet pointer entry 306 
in the current cache row 304a-b; that is, the row is filled, the full current cache row 
304a or 304b storing a plurality of packet pointers 128 is transferred to a cache row 

1 5 entry 320 in an empty packet vector 3 10 in packet vector DRAM 300 in a single transfer 
cycle. To transfer the current cache row 304a or 304b to packet vector DRAM 300, the 
current cache row 304a or 304b is read from SRAM cache 302, transferred on cache 
row data 3 12 to packet vector DRAM 300 and written in a cache row entry 320 in a 
packet vector 310 in packet vector DRAM 300. 

20 The transfer of the current cache row 304a or 304b to packet vector DRAM 300 

is performed using a single SRAM cache read cycle. Thus, a plurality of packet 
pointers 128 stored in packet pointer entries 306 in the current cache row 304a or 304b 
are transferred in a single SRAM cache read cycle. For example, if the current cache 
row 304a or 304b has twelve packet pointer entries 306 and each packet pointer entry 

25 306 is 17 bits wide, 204 bits are transferred on cache row data 3 12 in a single transfer 
cycle. Only one transfer cycle is required to transfer twelve packet pointers 128 stored 
in the cache row 304a or 304b. Thus, the transfer of the current cache row 304a or 304b 
from SRAM cache 302 uses only a small portion of the bandwidth of the SRAM cache 
302 and the packet vector DRAM 300. 
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While one cache row 304a or 304b is waiting to be transferred to packet vector 
DRAM 300, further packet pointers 128 can be enqueued in the other cache row 304a or 
304b. Thus, a packet pointer 128 is individually enqueued in a packet pointer entry 306 
in the SRAM cache 302 and a cache row 304a-c including a plurality of packet pointers 
5 128 stored in packet pointer entries 306 is written to packet vector DRAM 300 in a 
single transfer cycle. 

The packet vector 310 also includes a link field 316 and a count field 318. The 
count field 318 stores the number of packet pointers 128 stored in the cache row entry 
320. The link field 3 16 is provided for storing a pointer to the next packet vector 3 10 in 
10 the linked list of packet vectors. 

Packet pointers 128 are dequeued from the packet vector DRAM 300. The 
packet pointer 128 stored in the packet pointer entry 306 at the tail of the egress port 
queue 124a-e is forwarded on packet pointer data out 322. The packet pointer entry 306 
from which the packet pointer 128 is forwarded is determined by the contents of the 
15 count field 318. 

Thus, packet pointers 128 are enqueued in SRAM and dequeued in DRAM, 
allowing packet pointers 128 to be queued quickly in fast SRAM and stored in slow 
DRAM. 

Fig. 4 is a block diagram including the port queue 124 shown in Fig. 3 and 
20 associated control logic for enqueuing, dequeuing, and transferring packet pointers 128. 

A set of port registers associated with the egress port queue 124 are stored in 
port registers 406. The port registers 406 are described in conjunction with Fig. 7. The 
set of port registers stored in port registers 406 are accessible by the enqueue engine 404 
through SRAM enqueue port registers 410, by dump engine 402 through dump port 
25 registers 414 and by dequeue engine 400 through DRAM dequeue port registers 412, 

The enqueue engine 404 controls the enqueuing of packet pointers 128 in 
SRAM cache 302. To enqueue, the enqueue engine 404 forwards the segment buffer 
write memory address 416 on packet pointer data_in 308. The enqueue engine writes 
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the packet pointer data_in 308 in a packet pointer entry 306 (Fig. 3) in a cache row 
304a-b in SRAM cache 302. 

The enqueue engine 404 selects the cache row 304a or 304b in which to write 
the packet pointer entry dependent on the state of cache row 428. The state of cache 
5 row 428 is dependent on enqueue row 422 forwarded through SRAM address 
multiplexer 430. The state of enqueue row 422 is dependent on the state of port 
registers 406. 

The enqueue engine 404 selects the packet pointer entry 306 in the cache row 
304a-b dependent on packet pointer entry enable 420. The state of the packet pointer 
1 0 entry enable 420 is dependent on the state of the SRAM enqueue port registers 410. 
M The dump engine 402 controls the transferring of a cache row 304a or 304b from 

H SRAM cache 302 to packet vector DRAM 300. To transfer, the dump engine 402 first 

; |; performs a memory read cycle through SRAMRD 424 to enable the contents of an 

€ SRAM cache row 304a or 304b (Fig. 3) in SRAM cache 302 to be forwarded on cache 

f 15 row data 312. Next, the dump engine 402 performs a memory write cycle through 

9 DRAM-WR 426 to enable cache row 3 1 2 to be written into a cache row entry 320 (Fig. 

3) in a packet vector 3 1 0 (Fig. 3) in a packet vector DRAM 300. 

The dequeue engine 400 controls the dequeuing of packet pointers 128 from 
r = packet vector DRAM 300. To dequeue, the dequeue engine 400 reads a packet pointer 

20 128 stored in a packet pointer entry 306 (Fig. 3) in a cache row field 320 (Fig. 3) in a 
packet vector 310 (Fig. 3) in packet vector DRAM 300 and forwards the packet pointer 
128 on segment buffer read memory address 408. 

Fig. 5 is a block diagram illustrating a linked list of packet vectors 310a-c in the 
packet vector DRAM 300 shown in Fig. 3. The linked list includes three packet vectors 
25 31 Oa-c. Packet vector 3 1 0a is the first packet vector in the linked list. The link field 
316a stores the address of next packet vector 310b in packet vector DRAM 300. Packet 
vector 310b is the second packet vector 310b in the linked list. The link field 316b in 
packet vector 310b stores the address of next packet vector 310c in packet vector 
DRAM 300. Packet vector 3 10c is the third packet vector in the linked list. The link 
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field 316c in the packet vector 310c stores the address of the next packet vector 310 in 
packet vector DRAM 300 in which a cache row 304a or 304b may be written. 

Packet vector 310c is the last packet vector 310 in the linked list even though it 
includes a pointer to the next packet vector because the contents of the count field 318, 
5 link field 3 1 6 and cache row entry 320 store invalid data. For example, the invalid data 
stored in the count field 318 may be zero indicating that there are no packet pointers 128 
stored in the cache row entry 320. In order to add another packet vector to the linked 
list, the cache row entry 320, count field 31 8a and link field 3 16 of the next packet 
vector are written with valid data in a single packet vector DRAM memory write access. 
1 0 Each cache row entry 320a-c in the packet vector 3 1 Oa-c includes twelve packet 

S pointer entries 306. The number of packet pointer entries 306 is not limited to twelve, 

5 the number of packet pointer entries 306 is dependent on the memory access time of the 

h SRAM cache 302; that is, the time to transfer a cache row 304a or 304b to packet vector 

J:,: DRAM 300. By transferring twelve packet pointers 128 per transfer cycle instead of 

1 5 one packet pointer per transfer cycle reduces the band width of the SRAM cache 302 
I: consumed by the transfer cycle and allows more port queues 124a-e to be provided in 

i;' the same SRAM cache 302. 

C The size of the count field 318a-c is dependent on the number of packet pointer 

entries 306 in the cache row entry 320. For twelve packet pointer entries 306 the count 
20 field 3 1 8a-c is four bits wide. The size of the link field 3 1 6 is dependent on the size of 
packet vector DRAM 300. The link field 316 stores the address in packet vector 
DRAM 300 of the first location of the next packet vector 310. With a 12-bit link field, 
the linked list may include up to 4096 packet vector entries 310. 

One memory write operation to the packet vector DRAM 300 is required to add 
25 a packet vector 3 1 0 to the linked list because the next packet vector 3 1 0 has been 
prefetched and the address of the next packet vector 310 has been written in the link 
field 3 1 6 of the last packet vector 3 1 0 in the linked list. The write operation copies the 
cache row 304a-b (Fig.3) in SRAM cache 302 (Fig. 3) to the cache row entry 320 in 
packet vector DRAM 300 and writes the number of packet pointers 128 stored in the 
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cache row entry 320 into the count field 318. The number of packet pointers 128 stored 
in the cache row entry is also stored in the port registers 406 (Fig. 4). The port registers 
406 are described later in conjunction with Fig. 7. 

Fig. 6 is a block diagram of the SRAM cache 302 including two cache rows 

5 304a and 304b with each cache row including 12 packet pointer entries 306. The 
enqueue engine 404 (Fig. 4) forwards the packet pointer 128 to be written to a packet 
pointer entry 306 on packet pointer data_in 308. The cache row 304a or 304b to which 
the packet pointer 128 is to be written in a packet pointer entry 306 is selected 
dependent on the state of cache row 428 forwarded through SRAM address multiplexer 

10 430 (Fig. 4) from the enqueue engine 404. Having selected the cache row 304a or 304b 
in SRAM cache 302, the packet pointer entry enable 420 selects a packet pointer entry 
306 in the selected cache row 304a-b. The packet pointer data_in 308 is written to the 
selected packet pointer entry 306 in the selected cache row 304a-b. 

In one embodiment, the segment buffer memory 108 (Fig. 1) may store up to 

15 65536 data packets, thus each packet pointer 128 is 16-bits wide. A one-bit error field 
(not shown) is stored with the 16-bit packet pointer 128 in a packet pointer entry 306. 
The state of the error bit determines whether the data packet stored in segment buffer 
memory 108 at the location specified by the packet pointer 128 is a valid data packet. 
With seventeen bits per packet pointer entry 306, the width of a cache row 304a-b is 204 

20 bits (12 packet pointers x 17 bits). 

Fig. 7 is a block diagram of the port registers 406 associated with the port queue 
124 shown in Fig. 4. The port registers 406 include SRAM port registers 700 and 
DRAM port registers 702. The SRAM port registers 700 include a dump row number 
register 704, a fill row number register 706, a port entry number register 708, a cache 

25 full register 710 and a cache empty register 712. 

The DRAM port registers 702 include a current enqueue pointer 714, a next 
enqueue pointer 716, a number of packet vectors on queue register 718, a no packet 
vectors register 720, a current dequeue pointer register 722, and a next dequeue pointer 
register 724. 
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The enqueue engine 404 (Fig. 4) uses the contents of the SRAM port registers 
700 to determine the packet pointer entry 306 (Fig. 6) in a cache row 304a or 304b in 
SRAM cache 302 (Fig. 4) in which to enqueue a packet pointer 128. The dump engine 
402 (Fig. 4) uses the contents of the SRAM port registers 700 to determine which cache 
5 row 3 04a or 304b in SRAM cache 3 02 (Fig. 4) from which to transfer the packet 
pointers 128 to a cache row entry 320 to packet vector DRAM 300 (Fig. 4). 

The dump engine 402 (Fig. 4) determines from the contents of the DRAM port 
registers 702 the location in packet vector DRAM 300 (Fig. 5) of the next packet vector 
310 (Fig. 3) to be enqueued. The dequeue engine 400 (Fig. 4) determines from the 
10 contents of the DRAM port registers 702 the location in packet vector DRAM 300 (Fig. 
X 5) of the packet vector 3 1 0 (Fig. 3) from which to dequeue the next packet pointer 128. 

5 The port registers 406 are described in more detail in conjunction with Figs. 9A, 

9B, 10, and 11. 

; j. : Fig. 8 is a block diagram of a switch 1 00 including a forward vector 8 1 0 for 

r 15 determining the egress port queue 124a-e on which to enqueue a packet pointer 128. 

The switch 100 includes an ingress ports engine 800, a packet storage manager 802, a 
:f i segment buffer memory 108, and an egress ports engine 804. A data packet received by 

; the ingress ports engine 800 at an ingress port 132 is forwarded to the packet storage 

Z manager 802. The packet storage manager 802 forwards the data packet to segment 

20 buffer memory 1 08 with associated control signals on segment buffer memory address 
812. The received data packet forwarded on ingress data 808 by the ingress ports 
engine 800 is written in segment buffer memory 108 at the location indicated by a 
packet pointer 128. The writing and reading of data packets in segment buffer memory 
108 including the algorithm for locating packets in memory and thus generating 
25 pointers is described in co-pending patent application U.S. Patent Application Serial 
Number 09/386,589 filed on August 31, 1999 entitled "Method and apparatus for an 
Interleaved Non-Blocking Packet Buffer," by David A. Brown, the entire teachings of 
which are incorporated herein by reference. 
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After the data packet has been written to segment buffer memory 108, the packet 
storage manager.802 enqueues the packet pointer 128 in one or more egress port queues 
124 dependent on the state of the forward vector 810. The forward vector 810 includes 
a bit for each egress port in the switch 100. The enqueue engine 404 (Fig. 4) determines 
5 the ports on which to enqueue a packet pointer 128 dependent on the state of the 
corresponding port bit in the forward vector 810. 

For example, if the switch has 27 ports, the forward vector 810 is 27-bits wide. 
If the bit in the forward vector 810 corresponding to an egress port 130 in the switch 
100 is set T the packet pointer 128 is enqueued in the corresponding egress port queue 
10 124. Alternatively, in an alternative embodiment, if the state of the bit is '0' in the 
forward vector 810 the packet pointer 128 is enqueued in the corresponding egress port 
queue 124. 

The select signal 814 forwarded from the egress port engine 804 determines 
from which egress port queue 124, a packet pointer 128 is dequeued. The packet 
1 5 pointer 128 is dequeued and forwarded on segment buffer memory address 812 to read 
the data packet stored in segment buffer memory 108. The data packet stored at the 
location in segment buffer memory 108 corresponding to the packet pointer 128 stored 
in the selected egress port queue 124 is forwarded on egress data 806 to the egress port 
engine 804. The egress port engine 804 forwards the data packet on the corresponding 
20 egress port 130. 

Fig. 9A is a flow chart illustrating the steps performed in the enqueue engine 
404 shown in Fig. 4 for enqueuing a packet pointer 128 in a port queue 124. 

At step 900, the enqueue engine 404 (Fig. 4) determines whether a data packet 
received at an ingress port 132 (Fig. 1) has been written to segment buffer memory 108 
25 (Fig. 1). If so, processing continues with step 902. If not, processing continues with 
step 900. 

At step 902, the enqueue engine 404 (Fig. 4) initializes a port number variable 
(not shown) to the first port number in a group of port numbers associated with the 
enqueue engine 404. The ports associated with the enqueue engine 404 may be all the 
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ports in the switch or a portion of the ports in the switch 100. For example, a 27 port 
switch (P1-P27) may include four enqueue engines with three of the enqueue engines 
each enqueuing packet pointers 128 for eight ports (P1-P8, P9-15, P17-24) and the 
fourth enqueue engine enqueuing packet pointers 128 for three ports (P25-27). The 
5 enqueue engine 404 is not limited to eight ports or three ports described; any number of 
ports may be enqueued by an enqueue engine 404. The memory access time of the 
SRAM cache 302 determines the number of egress port queues that an enqueue engine 
4040 can enqueue. 

At step 904, the enqueue engine 404 (Fig. 4) determines from the forward vector 
10 810 forwarded from the ingress ports engine 800 whether a packet pointer 128 is to be 
enqueued in the port queue 124 corresponding to the current port number. If so, 
processing continues with step 910. If not, processing continues with step 906, 

At step 906, the enqueue engine 404 (Fig. 4) determines if the current port is the 
last port in the group of ports controlled by the enqueue engine 404 (Fig. 4). If so, 
1 5 enqueuing of data packet pointers 1 28 for the received data packet is complete and 
processing continues with step 900. If not, processing continues with step 908. 

At step 908, the current port number is incremented in order to enqueue the 
packet pointer 128 in the next egress port queue 124 controlled by the enqueue engine 
404. Processing continues with step 904. 
20 At step 910, the enqueue engine 404 (Fig. 4) reads the contents of the port 

registers 406 (Fig. 4) associated with the current port number. Processing continues 
with step 912. 

At step 912, the enqueue engine 404 (Fig. 4) examines the contents of the cache 
full register 710 (Fig. 7). If the contents of the cache full register 710 (Fig. 7) indicate 
25 that SRAM cache 302 is full; that is cache rows 304a and 304b for the current port are 
full, processing continues with step 914. If not, processing continues with step 916. 

At step 914, a system failure message is generated because the SRAM cache 302 
for the current port is full and no further packet pointers 128 may be enqueued in the 
egress port queue 124 for the current port. 
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At step 916, the packet pointer 128 is stored in a packet pointer entry 306 (Fig. 
6) in SRAM cache 302 (Fig. 6) for the current port dependent on the contents of the 
SRAM port registers 700 (Fig. 7). The cache row 304a or 304b in which to store the 
packet pointer 128 is dependent on the contents of the fill row number register 706 (Fig. 
5 7), and the packet pointer entry 306 (Fig. 6) in the selected cache row 304a-b in which 
to store the packet pointer 128 is dependent on the contents of the packet entry number 
register 708 (Fig. 7). 

The contents of the fill row number register 706 (Fig. 7) are forwarded on 
enqueue row 422 (Fig. 4) to an SRAM address multiplexer 430 (Fig. 4) and forwarded 
10 on cache row 428 (Fig. 4) to the SRAM cache 302 (Fig. 4) dependent on the state of a 
select signal 432. The state of the select signal 432 (Fig. 4) determines whether SRAM 
cache 302 (Fig. 4) is being written to enqueue a packet pointer 128 or read to transfer a 
cache row. 

The contents of the packet pointer entry number register 708 (Fig. 7) determine 
15 the packet pointer entry 306 in the selected cache row 302 (Fig. 4) in which to store the 
packet pointer 128. The enqueue engine 404 selects a packet pointer entry 306 
dependent on the contents of the packet pointer entry number register 708 (Fig. 7) and 
forwards the selected packet pointer enable on packet pointer entry enable 420 (Fig.4) to 
SRAM cache 302 (Fig. 4). The packet pointer 128 is forwarded on packet pointer 
20 data_in 308 to the selected packet pointer entry 306 in SRAM cache 302 (Fig. 4). 

Having selected the cache row 304a-b (Fig. 6) and the packet pointer entry 306 
(Fig. 6) in SRAM cache 302 (Fig. 3), the enqueue engine 404 (Fig, 4) enqueues the 
packet pointer 128 in the egress port queue by writing the packet pointer 128 in the 
selected packet pointer entry 306 (Fig. 6). Processing continues with step 918. 
25 At step 918, the enqueue engine 404 updates the contents of the SRAM port 

registers 700 (Fig. 7). The steps to update the contents of the SRAM port registers 700 
are described in conjunction with Fig. 9B. After the contents of the SRAM port 
registers 700 (Fig. 7) are updated, processing continues with step 906. 
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Fig. 9B is a flow chart illustrating the steps performed to update the SRAM port 
registers 700 (Fig. 7) by the enqueue engine 404 (Fig. 4). 

At step 920, the enqueue engine 404 (Fig. 4) sets the contents of the cache 
empty register 712 to '0* indicating that the SRAM cache 302 (Fig. 3) is not empty. The 
5 cache empty register 712 is monitored by the engine 402 dump to determine if there are 
packet pointers 128 to be transferred to packet vector DRAM 300. The cache empty 
register 712 is used if packet vector DRAM 300 is empty in order to determine if there 
are packet pointers 128 stored in SRAM cache 302. If the SRAM cache 302 is not 
empty, the packet pointer 128 may be moved to packet vector DRAM 300 before a 
10 cache row 304a or 304b is full in order to reduce the latency incurred by the switch 100 
in forwarding a data packet 126 from an ingress port 132 (Fig. 1) to an egress port 
130a-e (Fig. 1). Processing continues with step 922. 

At step 922, the enqueue engine 404 (Fig. 4) determines from the contents of the 
packet pointer entry number register 708 (Fig. 7) whether the current row is full. If so, 
15 processing continues with step 924. If not, processing continues with step 926. 

At step 924, the enqueue engine 404 (Fig. 4) toggles the state of the contents of 
the fill row number register 706 (Fig. 7) to move to the next cache row 304a or 304b 
(Fig. 6) processing continues with step 928. 

At step 926, the enqueue engine 404 (Fig. 4) increments the contents of the 
20 packet pointer entry number register 708 (Fig. 7) in the current cache row 304a or 304b 
(Fig. 6). 

At step 928, the enqueue engine 404 (Fig. 4) determines from the contents of 
dump row number register 704 (Fig. 7) if the next row has been transferred by 
comparing the contents of dump row number register 704 (Fig. 7) and the fill row 
25 number register 706 (Fig. 7). If the contents are the same, the current row has not been 
transferred yet. If the current row has not been transferred, the enqueue engine 404 
(Fig. 4) sets the contents of the cache full register 710 (Fig. 7) to * l\ The contents of 
the cache full register 710 are monitored by the dump engine 402 to determine if there is 
a cache row 304a or 304b to be transferred to packet vector DRAM 300. 
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Fig. 10 is a flow chart illustrating the steps performed in the dump engine 402 
shown in Fig. 4 for transferring a cache row 304 (Fig. 6) from SRAM cache 302 (Fig. 3) 
to a packet vector 310 (Fig. 5) in packet vector DRAM 300 (Fig. 5). The dump engine 
402 also adds the packet vector 3 10 in which the transferred cache row 304a or 304b is 
5 stored to the linked list of packet vectors 3 1 0 stored in packet vector DRAM 300 (Fig. 
5) for the egress queue 124a-e. 

At step 1000, the dump engine 402 (Fig. 4) determines if a transfer cycle may be 
started. If so, processing continues with step 1002. 

At step 1002, the dump engine 402 (Fig. 4) reads the SRAM port registers 700 
10 (Fig. 7) and the DRAM port registers 702 (Fig. 7) corresponding to the port queue for 
ii the current port. Processing continues with step 1004. 

i; At step 1004, the dump engine 402 (Fig. 4) determines if the contents of dump 

* row number register 704 (Fig. 7) are not equal to the contents of the fill row number 

register 706 (Fig. 7). If so, processing continues with step 1018. If not, processing 
15 continues with step 1006. 
r- At step 1006, the dump engine 402 (Fig. 4) determines if the cache is full from 

the contents of the cache full register 710 (Fig. 7). If the cache is full, processing 
continues with step 1018. If not, processing continues with step 1008. 

At step 1008, the dump engine 402 (Fig. 4) determines from the contents of the 
20 packet pointer entry number register 708 (Fig. 7) if the number of packet pointers stored 
in cache row 304a or 304b is greater than a predefined transfer threshold. If so, 
processing continues with step 1014. If not, processing continues with step 1010. 

At step 1010, the dump engine 402 (Fig. 4) determines from the contents of the 
no packet vectors register 720 (Fig. 7) if there are packet vectors 310 (Fig. 3) stored in 
25 packet vector DRAM 300 (Fig. 3) for the current port. If so, processing continues with 
step 1012. If not, processing continues with step 1000. 

At step 1012, the dump engine 402 (Fig. 4) determines from the contents of the 
packet pointer entry number register 708 (Fig. 7) if there are packet pointer entries 306 
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(Fig. 3) stored in the current row. If so, processing continues with step 1014. If not, 
processing continues with step 1000. 

At step 1014, the dump engine 402 (Fig. 4) sets the count field 318 (Fig. 3) in 
the next available packet vector 310 (Fig. 3) in packet vector DRAM 300 (Fig. 3) to the 
5 number of packet pointers 128 written in the partially filled cache row 304a or 304b 
(Fig. 3) to be transferred to packet vector DRAM 300 (Fig. 3). The contents of the fill 
row number register 706 (Fig. 7) are toggled to the next cache row number. For 
example, if the current cache row number is 1, the contents of the fill row number 
register 706 (Fig. 7) are toggled to '2'. The contents of the packet pointer entry number 
1 0 register 708 are initialized to ' 1 '. Processing continues with step 1016. 

At step 1016, the dump engine 402 (Fig. 4) sets the cache empty register 712 
(Fig. 7) to T indicating that the SRAM cache 302 (Fig. 3) is empty. Processing 
continues with step 1022. 

At step 1018, the dump engine 402 (Fig. 4) sets the count field 318 (Fig. 3) in 
1 5 the next available packet vector 310 (Fig. 3) in packet vector DRAM 300 (Fig. 3) to 12 
and or 304 (the maximum number of packet pointers 128 stored in packet pointer entries 
306 (Fig. 3) in a cache row 304a or 304b (Fig.3)). Processing continues with step 1016. 

At step 1020, the dump engine 402 (Fig. 4) reads the contents of the packet entry 
number 708 (Fig. 7). If the contents are set to the first packet entry (packet entry 1), 
20 processing continues with step 1016 which has previously been described. If not, 
processing continues with step 1022. 

At step 1022, the dump engine 402 (Fig. 4) transfers the contents of the cache 
row 304a-b (Fig. 4) selected by the dump row number register 704 (Fig. 7) into the 
current packet vector 310 (Fig. 3) in packet vector DRAM 300 (Fig. 3). The address of 
25 the current packet vector is stored in the current enqueue (Fig. 7) pointer 714 in DRAM 
port registers 702 (Fig. 7). The selected cache row 304a-b (Fig. 3) is transferred by 
reading the contents of the cache row 304a or 304b (Fig. 3) in SRAM cache 300 (Fig. 3) 
and writing the contents to a cache row entry 320 (Fig. 3) in the current packet vector 
310 (Fig. 3) in packet vector DRAM 300 (Fig. 3). In the same packet vector DRAM 
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access, the address of the next packet vector stored in the next enqueue pointer register 
716 (Fig. 7) in the DRAM port registers 702 (Fig. 7) is written to the link field 316 (Fig. 
3) of the current packet vector 310 and the count of the number of packet pointers stored 
in the cache row 304a or 304b is written to the count field 318 (Fig.3). Processing 
5 continues with step 1024. 

At step 1024, the contents of the SRAM port registers 700 and DRAM port 
registers 702 (Fig. 7) are updated as follows: the current enqueue pointer register 714 
(Fig. 7) contents are set to the contents of the next enqueue pointer 716. A next 
enqueue pointer obtained from a free list of pointers (not shown) is stored in the next 
10 enqueue pointer register 716 (Fig. 7). The cache full register 710 is set to not full. The 
J no packet vectors register 720 (Fig. 7) is set to '0' and the dump row number register 

■1: 704 Fig. 7) is changed to the number of the next cache row 304a-b (Fig. 7) to be 

''■-■<• transferred. 

^ : Fig. 1 1 is a flow chart illustrating the steps performed in the dequeue engine 400 

5 1 5 shown in Fig. 4 for dequeuing a packet pointer 128 from a port queue 124. 

& At step 1 1 00, the dequeue engine 400 determines if a packet pointer 128 should 

?f be dequeued. If so, processing continues with step 1 102. If not, processing continues 

I ; with step 1 100. 

h At step 1 1 02, the dequeue engine 400 (Fig. 4) reads the contents of the no packet 

20 vectors register 720 (Fig. 7). The contents of the no packet vectors register 720 indicate 
whether there is a packet vector available. If no packet vectors are available, processing 
continues with step 1 104. If packet vectors are available, processing continues with 
step 1106. 

At step 1 104, a system failure is generated because there are no packet vectors 
25 available. Processing is complete. 

At step 1 106, the dequeue engine 400 reads the packet vector 310 (Fig. 3) from 
packet vector DRAM 300 (Fig. 3) at the address in packet vector DRAM 300 (Fig. 3) 
stored in the current dequeue pointer register 722 (Fig. 7). The current packet pointer 
entry 306 (Fig. 3) in the current dequeue packet vector 310 is selected dependent on the 



2037.2002-000 

-21- 

contents of the next dequeue packet pointer register 724 (Fig. 7). The selected packet 
pointer 128 (Fig. 1) is forwarded on packet pointer data out 322. Processing continues 
with step 1108. 

At step 1 108, the contents of the next dequeue packet pointer register 724 are 
5 incremented to point to the next packet pointer 706 (Fig. 7) in the current dequeue 
packet vector 310 (Fig. 3). Processing continues with step 1110. 

At step 1110, the dequeue engine 400 (Fig. 4) determines by comparing the 
contents of the next dequeue packet pointer register 724 (Fig. 7) with the count field 318 
in the current dequeue packet vector 310 if the current packet pointer entry 306 stores 
1 0 the last packet pointer 128 in the current dequeue packet vector 310. If so, processing 
! ^ continues with step 1112. If not, processing continues with step 1 100. 

; {:: At step 1 1 12, the dequeue engine 400 (Fig. 4) sets the contents of the next 

J] dequeue packet pointer 724 (Fig. 7) to ' 1' to select the first packet pointer entry 306 in a 

r packet vector, removes the current packet vector from the linked list of packet vectors in 

^' 1 5 packet vector DRAM 3 00, returns the current dequeued packet vector 300 to a free list 

G of packet vectors (not shown) and sets the contents of the current dequeue pointer 

I ; register 722 to the contents of the link field 3 1 6 in the current dequeued packet vector 

310 (Fig. 3). Processing continues with step 1 100. 

While this invention has been particularly shown and described with references 
20 to preferred embodiments thereof, it will be understood by those skilled in the art that 
various changes in form and details may be made therein without departing from the 
scope of the invention encompassed by the appended claims. 
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CLAIMS 

is claimed is; 

A queue comprising: 

a first memory having a first memory access time; 

a second memory having a second memory access time; and 

control logic which enqueues in the queue a pointer to data to be 

transmitted by writing the pointer in the first memory and transferring the 

pointer to second memory. 

A queue as claimed in Claim 1 wherein the first memory access time is less than 
the second memory access time. 

A queue as claimed in Claim 1 wherein the control logic transfers a plurality of 
pointers to the second memory in a single transfer cycle. 

A queue as claimed in Claim 1 wherein the control logic enqueues the pointer in 
the first memory in a single write operation and establishes a linked list of 
pointers in the second memory after the write operation. 

A queue as claimed in Claim 1 wherein the control logic dequeues the pointer by 
reading the pointer from the second memory. 

A queue as claimed in Claim 1 wherein the control logic fills a cache row in the 
first memory before transferring the cache row into the second memory. 

A queue as claimed in Claim 6 wherein the first memory transfers the cache row 
in a single write operation. 
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8. A queue as claimed in Claim 1 wherein the control logic partially fills a cache 
row in the first memory before transferring the cache row into the second 
memory in a single write operation. 

5 9. A queue as claimed in Claim 1 wherein entries in a cache row in the first 
memory are ordered by position in the cache row. 

10. A queue as claimed in Claim 1 wherein the first memory includes two cache 
rows. 

10 11. A queue as claimed in Claim 1 wherein a packet vector stored in the second 

memory includes a cache row entry and a count of the number of pointers stored 
in a cache row entry. 

12. A queue as claimed in Claim 1 or Claim 1 1 wherein a packet vector stored in the 
second memory includes a link to a next packet vector in the queue. 

15 

13. A queuing method comprising the steps of: 

writing in a first memory having a first memory access time a pointer to 
data to be transmitted; and 

transferring the pointer to a second memory having a second memory 

20 access time. 

14. A queuing method as claimed in Claim 13 wherein the first memory access time 
is less than the second memory access time. 



15. 

25 



A queuing method as claimed in Claim 13 wherein the step of transferring 
forwards a plurality of pointers to the second memory in a single transfer cycle. 
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16. A queuing method as claimed in Claim 13 wherein the step of writing writes the 
pointer in a single write operation to the first memory and establishes a linked 
list of pointers after the write operation. 

17. A queuing method as claimed in Claim 13 further comprising the step of: 
5 dequeuing the pointer from the second memory. 

18. A queuing method as claimed in Claim 1 3 wherein the step of transferring 
forwards a full cache row into the second memory. 

19. A queuing method as claimed in Claim 13 wherein the step of transferring 
forwards a partially filled cache row into the second memory. 

10 20. A queuing method as claimed in Claim 1 8 or Claim 1 9 wherein the cache row is 
transferred in a single write cycle. 

21 . A queuing method as claimed in Claim 13 wherein entries in a cache row in first 
memory are ordered by position in the cache row. 

22. A queuing method as claimed in Claim 13 wherein the first memory includes 
15 two cache rows. 

23 . A queuing method as claimed in Claim 1 3 wherein a packet vector stored in the 
second memory includes a cache row and a count of the number of pointers 
stored in the cache row. 

24. A queuing method as claimed in Claim 13 or 23 wherein a packet vector stored 
20 in the second memory includes a link to a next packet vector. 
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25. A queue comprising: 

a first memory having a first memory access time; 
a second memory having a second memory access time; and 
means for controlling the queue enqueues in the queue a pointer to data 
5 to be transmitted by writing the pointer in the first memory and transferring the 

pointer to second memory. 

26. A queue as claimed in Claim 25 wherein the first memory access time is less 
than the second memory access time. 

27. A queue as claimed in Claim 25 wherein the means for controlling the queue 
1 0 transfers a plurality of pointers to second memory. 

28. A queue as claimed in Claim 27 wherein the plurality of pointers are transferred 
in a single transfer cycle. 

29. A queue as claimed in Claim 27 wherein the means for controlling the queue 
enqueues the pointer in a single write operation to the first memory and 

1 5 establishes a linked list of pointers after the write operation. 

30. A queue as claimed in Claim 27 wherein the means for controlling the queue 
dequeues the pointer by reading the pointer from the second memory. 

31. A queue as claimed in Claim 27 wherein the means for controlling the queue 
fills a cache row in the first memory before transferring the cache row into the 

20 second memory. 

32. A queue as claimed in Claim 3 1 wherein the cache row is transferred to the 
second memory in a single write operation. 
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33. A queue as claimed in Claim 25 wherein the means for controlling the queue 
partially fills a cache row in the first memory before transferring the cache row 
into the second memory. 

34. A queue as claimed in Claim 25 wherein entries in a cache row in the first 
5 memory are ordered by position in the cache row. 

35. A queue as claimed in Claim 25 wherein the first memory includes two cache 
rows. 

36. A queue as claimed in Claim 25 wherein a packet vector stored in the second 
memory includes a cache row entry and a count of the number of pointers stored 

10 in a cache row entry. 

37. A queue as claimed in Claim 25 or 36 wherein a packet vector stored in the 
second memory includes a link to a next packet vector in the queue. 

38. A pointer list comprising: 

15 a first memory having a first memory access time; 

a second memory having a second memory access time; and 
control logic which adds in the pointer list a pointer to data to be 
transmitted by writing the pointer in the first memory and transferring the 
pointer to second memory and removes the pointer from the pointer list by 
20 reading the pointer from the second memory. 
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PORT PACKET QUEUING 
ABSTRACT OF THE DISCLOSURE 

5 A port queue includes a first memory portion having a first memory access time 

and a second memory portion having a second memory access time. The first memory 
portion includes a cache row. The cache row includes a plurality of queue entries. A 
packet pointer is enqueued in the port queue by writing the packet pointer in a queue 
entry in the cache row in the first memory. The cache row is transferred to a packet 

1 0 vector in the second memory. A packet pointer is dequeued from the port queue by 
reading a queue entry from the packet vector stored in the second memory. 
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